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OBJECTIVES 

The  long  term  goal  of  this  project  is  to  increase  the  level  of  autonomy  in  AUVs  as  they 
are  being  used  for  more  complex  missions  than  mine  countermeasures.  Part  of  this 
increase  in  autonomy  will  rely  on  obstacle  detection  and  avoidance  and  will  require  a 
forward  looking  sonar  (FLS)  suitable  for  small  vehicles.  In  the  past  year,  the  NPS  Center 
for  AUV  Research  has  mounted  a  University  of  Washington  Applied  Physics  Lab 
(UW:APL)  Blazed  Array  Forward  Looking  Sonar  (FLS)  on  the  NPS  ARIES  AUV  and 
has  conducted  several  data  collection  tests  in  Monterey  Bay.  The  goal  of  the  project  is  to 
develop  Obstacle  Avoidance(OA)  algorithms  for  small  AUVs  using  image  analysis  in  a 
dynamic  real  time  system  for  detection  and  avoidance. 

APPROACH 

The  approach  is  both  theoretical  and  experimental.  Theoretical  methodology  is  derived 
from  Artificial  Potential  Functions  which,  when  globally  minimized,  provide  guidance 
paths  for  AUVs  that  both  track  the  waypoints  of  the  mission  but  avoid  objects  in  the  way. 
The  methodology  is  useful  for  both  horizontal  and  vertical  plane  avoidance.  This  is  tied 
with  real  time  image  analysis,  bottom  feature  extraction,  and  networked  commands  to  the 
vehicle  guidance  and  control  system.  The  system  is  being  implemented  in  the  REMUS 
vehicle  as  well  as  the  ARIES  vehicle  at  NPS.  Follow  on  work  is  being  conducted  for  the 
Feature  Based  Navigation  project  at  NPS,  reported  separately. 


Figure  1 .  ARIES  Underway  with  Blazed  Array  FLS  in  Nose,  Keyport,  June  2005 

RESULTS 
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During  FY  2005,  NPS  installed  a  two  array  FLS  set  from  Blueview  Technologies,  Inc. 
into  the  nose  cone  of  the  ARIES  AUV.  Our  participation  in  the  AUV  Fest  2005  exercise 
in  Keyport,  WA.  has  been  reported  in  [1],  and  more  details  as  to  the  analysis  of  images 
obtained  from  the  Blazed  Arrays  are  given  in  the  paper  presented  at  Oceans  2005  [2]. 
During  2006,  the  theoretical  and  modeling  background  using  (Artificial  Potential 
Functions)  APF,  has  been  developed  further  and  is  the  subject  of  the  book  chapter  [3]. 
Also,  the  subject  of  a  major  presentation  and  paper  given  at  the  Maneuvering  and  Control 
of  Marine  Craft  conference  in  Lisbon,  September  2006  gave  further  details  with  the 
complete  development  from  APF  Guidance  to  the  details  of  Blazed  Array  image  analysis 
and  control  for  the  ARIES  vehicle,  [4], 

APF  Guidance  Theory 

Given  a  total  Global  Potential  Field, 

V(X,Y,Z,a)>  0, 

composed  of  track  following  potentials  and  obstacle  avoidance  potentials,  with 
parameters,  a,  set  according  to  vehicle  motion  constraints  of  curvature,  the  vehicle 
desired  path  in  a  global  Navigational  Frame,  X,Y,Z,  evolves  according  to 

x  =  f (u),  x  =  [X, Y ,Z]T 

U  =  [l/S  com’Q com] 


so  that  the  projection 


W.f  <  0  V  t  >  0 

In  developing  potential  functions  for  path  tracking  and  obstacle  avoidance,  it  is  assumed 
that  functions  will  be  used  such  that  there  is  a  unique  local  minimum  in  the  region  of 
interest,  and  that  the  gradient,  ||VF||  ^  0  anywhere. 

The  path  generation  model  is 


X  =  U  cos(y/com  ) 

Y  =  Usin(y/com) 

z  =  -uecom 

Where,  U  is  the  forward  speed  of  the  vehicle. 

The  reduction  of  the  potential,  V,  is  accomplished  using 


/  =  - 
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From  which  V  =  -VV1 


r/l  0  0 

0  Vi  0 

0  0  ^3 


VV < 0  V  t>0 


and  the  r/j  are  disposable  positive  parameters  to  give  some  degree  of  adjustment  in  the 
resulting  path. 

The  path  is  generated  as  the  evolution  of  [X(t),  Y(t),  Z(t)\  subject  to  initial  conditions 
taken  from  the  vehicle’s  current  position  at  t  =  to. 

Decoupling  the  path  generation  into  horizontal  and  vertical  planes,  we  get 
Horizontal  Path  Generation : 


U  cos(y/com  f 

O' 

_U  sin(y/com)\ 

0 

1 2  _ 

K_ 

Leading  to  a  solution  for  the  heading  command.  Using,  rj  =  —, 

7i 


V com  =  a  tan( -Vy  ,-rjV'x  ) 


Vertical  Plane 

Considering  the  vertical  plane  separately,  the  solution  for  the  path  pitch  angle  becomes, 

-uecom  =  v'z 


Potential  Function  Selection 

A  UUV  mission  will  be  defined  in  terms  of  a  series  of  waypoints  with  nominally  straight 
line  segments,  and  conditions  for  transition  from  one  to  the  next.  To  follow  a  track 
defined  by  2  waypoints,  /+/  and  i,  we  define  a  track  heading, 

Vtmck=atan((Yi+l-Yi),(Xi+l-Xi)) 

and  define  along  track  and  cross  track  potentials,  Va  and  Vc 

K=(1~  Ps)>  K  =  kP2 K  =  M2 

where  s  is  the  along  track  distance,  the  cross  track  error  is,  e,  and  z,  the  vertical  deviation 
from  the  nominal  altitude  /depth  command.  The  track  following  gradients  of  potentials 
are  incorporated  into  the  total  Global  Potential  Field  gradient  by  the  3*3  rotation  matrix, 

P(  y/frack  )  t 


track 


=  T(¥lrack)[V'a;V'c;V':  ] 
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These  potentials  alone  will  drive  the  vehicle  through  a  set  of  way  points  provided  suitable 
logic  is  included  for  track  termination  (see  Healey,  2006). 


Avoidance  when  objects  are  detected  at  locations,  \xjr  yjy  zj ],  is  accomplished  through 
addition  of  the  Gaussian  potentials,  Voj 

N 

Voj  =  exp[(( X  -  xi  )2  +(Y  -  yt)2  )/2af  ]  for  the  horizontal  plane  avoidance  and 

i=i 

N 

Voj  =  YjV,  exp[ (( X -xj)2  +(Z -zoj)2) / 2crj 7  for  vertical  plane  avoidance  and  zo  is  a  depth 

i=\ 

for  the  object  to  be  avoided.  Gradients  of  the  avoidance  potentials  are  added  to  the  track 
following  gradients  for  the  total  potential  field  gradient  computation. 

The  total  gradient  in  the  X  and  Y  and  Z  directions  are  then 

K 

V'y 

vz 


=  YJK,x+K 
=  ZKr+K, 
=Y,Kz+K. 


Path  Following 

Path  Following  responses  of  the  REMUS  vehicle  are  simulated  and  described  more  fully 
in[l]. 

Blazed  Array  FLS,  Object  Detection 

The  Blazed  Array  Forward  looking  Sonar  FLS  can  be  configured  either  in  the  horizontal 
or  vertical  planes.  In  the  vertical  plane,  it  is  suitable  for  detecting  sudden  rises  in  sea 
bottoms  that  would  otherwise  cause  the  vehicle  to  ground  while  performing  mine  hinting 
missions  close  to  the  seabed. 

The  obstacle  detection  part  is  a  critical  part  of  the  control  system  and  first  begins  with 
image  gathering  and  analysis. 

Figure  2  illustrates  the  nominal  projection  of  sound  fro  m  the  arrays  with  the  vertical 
mounting.  Using  a  normal  to  the  vertical  surface  of  the  stave  as  a  reference,  the  high 
frequencies  emanate  outward  at  approximately  22.5  degrees  and  the  low  frequencies  at 
45  degrees.  Each  stave  also  has  approximately  12  degrees  of  horizontal  aperture  . 

Figure  3  is  an  example  of  two  images  from  Blazed  Array  mounted  on  the  NPS  ARIES. 
The  sonar  transducer  attached  to  the  ARIES  AUV  is  located  at  the  top  left  corner  of  each 
image.  The  strong  linear  return  in  each  of  the  images  is  typical  of  an  ocean  floor  without 
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obstacles.  The  volume  above  the  ocean  floor  is  the  cnsonificd  portion  of  the  water 
column  and  is  bounded  by  the  upper  and  lower  frequency  of  each  sonar  stave. 


Figure  2.  Projection  of  the  Blazed  Array  Sonar  on  the  Seabed  Vertical  Configuration 

For  our  application,  the  sonar  is  set  to  a  medium  low  resolution  which  results  in  an  image 
size  49 lx  198  pixels  or  an  effective  range  of  approximately  80  meters.  This  resolution 
permits  a  1  Hz  sonar  update  rate  which  is  reasonable  for  obstacle  detection  for 
avoidance.. 

Relating  to  Figure  3,  di  and  d?  represent  the  distance  calculations  from  the  nearest  and 
farthest  sonar  beams  (respectively)  as  they  reflect  off  a  featureless  ocean  floor.  ©r  is  the 
total  angle  measurement  taking  into  account  the  sonar  mounting  angle  ( @„ )  and  the  pitch 
of  ARIES  at  time  t,  (  &(t) ). 


d j  =  h  tan( 0T  ) 
d2  =  h  tan( 0T  +22.5) 
0T  =45  +  0a+0(t) 


Figure  3  Geometry  of  Image  and  Seabottom  Ensonification 
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NPS  ARIES  FLS  Blazed  Array  Sonar 


0  50  100  150  200  250  300  350  400  450 

Blazed  Array  stave  2 


0  50  100  150  200  250  300  350  400  450 

Downrange 


Figure  4.  Vertical  Configuration  for  Arrays  Showing  Strong  Returns  from  Flat  Seabed. 
Image  returns  from  a  submerged  pipeline  are  shown  below. 


The  large  strong  returns  above,  indicate  that  at  40  meters  out,  a  6  meter  high  object  lies  in 
front  of  the  vehicle  and  an  avoidance  maneuver  is  required.  The  vehicle  smooth 
avoidance  response  is  clearly  shown  in  Figure  5  below. 
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dive  planes  (b)and  Depth(r),  and  Alt(g)  vs  time 


Figure  5  Vehicle  Response  to  Submerged  Pipeline,  Monterey  Bay,  June,  2006 
Hardware  And  Software  Architecture 

A  principle  feature  of  the  ARIES  AUV  is  its  flexibility  for  housing  new  hardware  and 
software  for  testing  new  methodologies  in  underwater  robotics.  There  are  three 
components  of  the  Blazed  Array  sonar:  The  arrays,  the  electronics  and  a  PC- 104 
computer  for  image  storage  and  processing.  The  original  bow  design  was  modified  to 
mount  the  arrays.  To  maintain  hydrodynamic  efficiency,  flexible  polyurethane  nose  was 
constructed  to  house  the  arrays.  This  minimizes  signal  attenuation  and  provides  a  degree 
of  protection.  The  construction  of  the  nose  permits  the  arrays  to  be  oriented  either  in  the 
horizontal  or  vertical  position. 

The  power  and  control  signals  are  passed  through  a  water  tight  bulkhead  and  attached  to 
the  electronics.  From  there,  images  are  saved  and  processed  using  a  Windows  based  PC- 
104  computer. 


System  Description  for  Perception  and  Avoidance  Control 


Autopilot  Controller 

Perception, 

Avoidance  Behavior: 

Image  Analysis, 

Activation,  Calculation  and  Monitoring 

Threat  Detection 
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QNXRTOS 


802.11b 
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TCP/IP  Connection 
—  Ethernet  switch  — 


WLAN  Bridge 


Sonar 

Collection 

and 

Processing 


PC- 104 
Cool  Runner 
Windows  XP 


Figure  6  .Hardware  /  Software  Diagram  for  FLS  Obstacle  Detection  and  Avoidance. 

Mounted  in  ARIES  June  2006 
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TRANSITIONS 


Capability  being  transitioned  into  the  REMUS  vehicle. 
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